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SUBSUB - fl Submarine Engagement Model 



James N. Eagle 

Department of Operations Research 
Naval Postgraduate School. 

Monterey, Cfl 93943 

Introduction 

This document reports the results of an examination of the submarine 
engagement model SUB SUB, written by P re search, Inc. of Fairfax, Vfi, and 
modified for use at the Naval UJar College (NUJC), Newport, Fil . This 
model considers a submarine versus submarine interaction from search 
through detection, classification, localization, closure, attack, and 
counterattack. The submarine missions modelled in are barrier patrol, 
area patrol, and transit. The version of SUBSUB examined runs on an 
I B M-P C . Other v e r s i o n sexist which ope r a t e o n L a r g e r c o rn p u t e r s . 

Purpose of this Study 

The primary purpose of the examination was to assess the modelling 
methods used in SUBSUB and to judge the program's usefulness for 
seminar war gaming at NUJC. This evaluation was conducted using 
documentation and FORTRAN source code supplied by Presearch, Inc. 

fl secondary purpose of the examination was to describe the basic 
models involved and suggest possible improvements or extensions. 

Limits of this Study 

SUBSUB is an extensive model, or more accurately, an integrated 
collection of models. The examination considered in detail the available 
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documentation and FORTRRN source code for the search, detection, and 
closure modules. The environmental and platform data bases mere not 
examined. 



SUBSUB OueruieiD 

SUBSUB models one-on-one barrier, area, and transit search missions 
for submarine platforms. It is an analytical model, as opposed to a 
discrete time step simulation. The submarine can be assigned a variety 
of current or projected sonar systems and rneapon capabilities. Each 
platform is modelled in either an aggressive or evasive posture. 
Countermeasures are allomed. Each encounter begins mith detection 
and continues through classification, localization, closure, attack, and 
counterattack. Figure-of-merit inputs (target source levels and 
environmental parameters) are dratun from a disk-based data base. The 
version of SUBSUB examined contained only minter environments, but 
others could presumably be added as necessary. 

The program begins mith the user reviewing the last selections for 
environment, scenario, platforms, sensors, and weapons. Any or all of 
these selections can be changed. The possible scenarios for the 
opposing submarines (called Blue and Red) are: barrier search/transit, 
area search/transit, area search/area search, transit/transit, and direct 
support/penetrator. 

When the user is satisfied mith the initial conditions, the program 
calculations are begun. Outputs of the program include all input data, 
nominal detection and counterdetection ranges (apparently the 
maximum range at which mean signal excess is 0), and a sequence of 
calculated probabilities for Blue and Red detection, closure, attack. 
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counterattack, and kill. Random variables uniformly distributed 
between 0 and 1 are compared to each calculated probability. If the 
random variable is less than the probability, the event in question is said 
to occur. The model then progresses to the next event in the 
engagement event tree. For example, if it is determined that Blue 
achieves a secure detection, the next probability calculated is that of 
correct classification by Blue, followed by closure, localization, and 
attack. 



Detailed Model Description 

Probabilit y Densit y for Detection Ran ge. For the selected Location and 
season, a propagation loss curve is retrieved from a disk-based 
database. Using the passive sonar equation a mean figure-of-rnerit 
(FOM) is calculated. The actual figure-of-rnerit is assumed to be 

FOM = FOM + t 

where £ is a normally distributed random variable with mean 0 and 
standard deviation specified by the program. Using the selected 
propagation loss curve, a detection range is associated with each value 
of FOM. In this manner a density function for detection range is 
determined. (Figurel.) 




Figure 1. Probability Density Function for Detection Range. 



The same calculation is done for the target, resulting in a density 
function for counterdetection range. Although it is riot clear from the 
documentation or source code, the range associated with each FOM is 
most likely the maximum range such that propagation loss equals FOM. 

An implicit assumption of this model is that detection arid 
counterdetection ranges are fixed during the entire encounter at values 
determined by probability distributions. This is iri contrast to discrete 
time step computer simulations using Lambda-sigma or Gauss-Markov 
detection models, where time-varying fluctuations in the environment 
cause these ranges to change over time. 

Distribution of Minimum Flan g e Achieved durin g Search. If p(t] is the 
minimum range achieved during the search from time 0 to time t, then 
P CPfl (t,R) is defined as 
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Prob{p(t) ^ R} 

The functional form of F' CPfi changes uuith the geometry of the encounter. 
In the barrier search problem, P CFfl is assumed only a function of R. That 
is, P cpr (R) is the probability that the minimum range achieved during the 
barrier penetration is R or less. The calculation of P CPfl for barrier and 
area search geometries mill be discussed in detail later. 

Probabilit y of Secure Detection ( PCD ). The probability of secure 
detection is computed by conditioning on the detection range of the 
searcher. Specifically, if f R (r) is the density function for detection range 

and R cd is counterdetection range, then the probability of achieving a 

secure detection by time t is 

00 

*> 

Prob{R CD «r] f RD (r) P CPR (t,r) dr. (1) 

o 

In SUBSUB, DCD is evaluated by conditioning on the searcher FGM. 

Letting r(p] be the detection range associated mith FOM v and f F0M (p| be 
the probability density function for FOM, then DCD becomes 

CO 

*'/ 

Prob{R,- Cr <r(p)} f F0M (p) P rpfl (t. r(p)) dp. (2) 

o 

-oo 

This expression is integrated numerically. The probability of a secure 
counterdetection is computed similarly. 

This method of calculating the probability of a secure detection has 
much to recommend it. fis opposed to the procedures of reference [1], 
this method incorporates the relative motion between the searcher and 



target. Thus the probability of achieving a secure detection in an area 
search mission will in general be different from that in a barrier mission. 
This occurs because the distribution of CPfl ranges is different for the 
two cases. 

The disadvantage of this approach, however, is the requirement to 
perform a numerical integration. This slows the execution of the 
program. But it should be noted that even the simpler, geometry- 
independent method of reference [1] requires numerical integration [or 
extensive table look up). It appears that this is the numerical price that 
must be paid for secure detection calculations when detection and 
counterdetection ranges are random variables. 

If searcher has a significant acoustic advantage, then these 
calculations are probably not necessary. In this case, the probability of 
secure detection by time t approximately equals the probability of 
detection by time t. But when detection and counterdetection 
capabilities are nearly equal, then it becomes more important to 
carefully consider the target's potential to counterdetect. 

Barrier search FV p P . From the SUBSUB documentation, P CPfl (R) for a 
searcher conducting a barrier patrol against a target with a constant 
course and speed is 



6 



(2R/IBW sin p)) - (R 2 /(BLU T tan 2 p)) + (2R,/(BUJ T tan p)] 



(3) 



inhere 

fi, = ((90-p)/360) JTR 2 if R < (BLU-TJ/Z 
or 

fl, = . 5((BLU-T)/2] 2 tan cr + (90-p-cr)7TR 2 /360 if (BLU-TJ/2 < R < (BLJ-T)/( 
or 

R, = .5((BUU-T)/2) 2 (1/tan p] if R > (BUJ-T)/(2sin p). 

The other definitions are: 

T = width of searcher's track, 

BID = barrier width (the target's penetration is uniformly distributed 
over this length], 

V'o = searcher speed, 

V T = target speed, 
p = tan- 1 (V t /V i:i ), 
cr = cos’ 1 KBIU-T)/(2R)). 

This expression is a modification of the "standard" calculations in 
Koopman's reference [2]. The general computational method used here 
is to consider the barrier penetration in "target-stationary relative 
space". That is, the target is assumed to be stationary, and all relative 
speed for the encounter is provided by the searcher. The searcher's 
relative speed component across the barrier front is the searcher's 
actual speed,' V 0 Arid the component of relative speed perpendicular to 
the barrier is the target speed, V T . Then the probability that the target 
comes within range R of the searcher during a barrier penetration is the 
ratio of the area "covered" by the searcher in relative space during one 



pass across the barrier to the total area that could be occupied by the 
target. In Figure 2., this covered area is shaded. 



BW 




IYl 

Vn 



Figure 2. Calculation of P rpA for Barrier Search. 



There are several problems uuith (3). The first is that (3) approaches 
negative infinity as V T becomes small or R becomes large. The physical 
explanation for this is that the method used to calculate the area of the 
shaded region of Figure 2. (i.e., dividing the region into parallelograms, 
triangles and sections of circles) fails for small 'v' T or large FI. The 
mathematical reason for this behavior is that the second additive term 
in (3) dominates the other tuuo terms in these limiting cases. 



By may of example. Figure 3. is a plot of R CPfi , as calculated by 13), for 
target speeds, V T , of 1 to 10 knots. Here R is 18 nautical miles (nrn), V 0 is 
10 knots, BLU is 100 nrn, and T is 60 nrn. Since the actual P CPfl should be a 
decreasing function of V T , the calculated values for V T less than about 
2.5 knots are suspect. 




Figure 4. is a plot of P CPfl vs. range, R. In this example, V T is 5 knots; R 
varies from 20 to 60 nm; and V 0 , BUJ, and T are as before. Actual P cpfl 
should be an increasing function of R (as long as P CPfl < 1, at least) but is 
seen here to decrease for R greater than about 36 nm. 

Although not mentioned in the supplied documentation, the SUBSUB 
code (in subroutine ACPAj modifies (3) so as to reduce the problem 
created by large values of R. Specifically, when R > (Blii-T)/(2 sin p), then 
P CPft is calculated with R set to rnin{R,(T tan 2 pj/sinp}. This change 
prevents P CPfl from approaching negative infinity, but can introduce a 
discontinuity into the function and does not prevent P CPfl from 
decreasing with increasing R. 




Figure 4. SUBSUB P 

- CPA 



vs. R as in documentation and source code. 



Another problem with the approach used to derive (3) is that it is not 
applicable for BLU < T. In fact, the BLU terms in the denominators of the 
additive terms of (3) cause the calculated P CPR to become infinite as BLU 
approaches 0. The SUBSUB program does not warn the user that BLU < T 
is not allowed. 

fl third (and relatively minor) problem with (3) is that if the 
methodology use to compute Rl in the first two cases is followed for th 
third case (i.e., when R >(BUJ-T)/(2sin p]), then HI should be 

,5{ ((BHI-T)/2) 2 (1/tan p) - (tan p)(R - (BLU-T)/(2sin pjj 2 }. 

However, as discussed above, using this methodology at all is not 
recommended. 

Alternative analytical barrier models are available which avoid 
these problems and are more general in their application. A good 
example is the JOTS II (Joint Operational Tactical System) barrier model 
described in [4]. This model generalizes slightly the computational 
method in Koopman [2] to estimate R CPfl (x), the probability of coming 
within range R of a transitor when the barrier penetration point is x. 
This probability is given as 



inhere 



PcprIx) = rnin (f(x), 1} 



H) 



fix) 



2RK/T for |x| N < T/2 - RK 

(RK/T) + (T/2 - |x|)/T) for T/2 - RK ,< |x| < T/2 +R/K 
(1/T) v'tR 2 “ 1 1 x | -T/2) 2 ) (K 2 -D for T/2 + R/K N < |x| 4 T/ 
0 for I x 1 >> T/2 + R 



K = \/'l + (V 0 /V T J- , 

and x is 0 at the center of the searcher track T. 

If the barrier penetration point is given by a probability distribution, 
g x (x), then 



(T/2)+R 

Pcpfl = J PcpfiM gxix'J dx. ‘ (41) 

-(T/2) -R 

Currently, the SUBSUB model implicitly assumes that the barrier 
penetration point is a uniformly distributed random variable with mean 
0. Using (41) allows any distribution of penetration points. For example, 
an attractive strategy for the target would be to attempt to maximize 
|x| (that is, penetrate as far as possible from the center of the barrier), 
since fix) is noriincreasing in |xj. 

When the assumption of a uniform distribution of penetration points 
with mean 0 is acceptable, then it is possible to closely approximate (41) 
with a closed form expression. There are three cases: 
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Kt 



min {2RK/T, 1} for BLU 4 T - 2RK 

1 - {(1/BUJ T) [max{.5(T+BUJ) - RK, 0}] 2 } for T-2RK <Btlk< T+2R 
^ ((T+2R)/BUI) (1- [max{T-R(K-1), 0}] 2 /(T 2 +2RT)) for BUH T+2R 



P CF'fl - 



tuhere K is as before. 

Barrier Search Probabilit y of Closure f Pr L ). The SUBSUB documentation 
describes two different methods for estimating P CL , which is the 
probability of successfully closing a target detected during barrier 
search. The first method appears to compare the time required for the 
searcher to approach to within weapons range using a bearing rider 
track (i.e., the relative bearing of the target is always 000°) to the time 
required for the target to escape out the bottom of the search area. 

The angle R0 B mrx is calculated, which is the maximum angle-on-the-bow 
at detection allowing closure to weapon range before the target 
escapes. Then based on a geometrical construction which is equivalent 
to assuming a cosine distribution of target ROB at detection, the 
probability that the actual ROB will be less than R0B MflX is determined. 
This is taken to be P CL . Although appearing in the documentation, this 
method was not implemented in the version of SUBSUB received for 
review. 

In the SUBSUB code (subroutine BCLOSE), a more direct method is used 
to determine A0B MFlX . But then R0 B mrx is converted to P CL in a 
n o n s t a n d a r d rn a n n e r . 

The program assumes that the searcher requires a specified length of 
time (variable TIM) to conduct target motion analysis (TMfi). 



Immediately after detection, the searcher heads for where the target 
will be at the end of the TMfi period. (The documentation differs from 
the code by stating that the searcher closes down the initial target 
bearing.) fit the end of the TMFI period, the searcher takes a corrected 
intercept course for target closure. If the searcher can close to within 
weapon range before the target exits the barrier area, then the initial 
ROB at detection is determined to be small enough to allow closure. The 
program iterates through various initial ROB's (first in 10° then in 1° 
increments) until the maximum ROB allowing closure is found. 

This much is straightforward. However, the program then converts 
RuB Mfl y into a probability of closure in a fashion that requires further 
justification. 

One "standard" assumption (which is implicitly used by the first 
procedure described in the documentation) is that initial ROB will have a 
cosine distribution. Specifically, reference (3) gives the probability 
density function of ROB at detection as 



.5 cost© - y), -n/2 + }••• 4 © 4 n7 2 + y 



0 , otherwise 



where y - tan -1 (V(/V T ) is the mean ROB at initial detection. Given a 
density function for ROB and a constant R0B mrx , P CL can be determined 
by integrating the density function from -R0 B mrx to R0B MRX (which is 
particularly simple for the distribution f(@) given above). 

In SUBSUB, P CL is computed using f(0) when the searcher detection 
range is sufficiently small (specifically, less than T/(20 sin(R0B MflX )). find 
for larger detection ranges, P CL increases linearly to a maximum value, 



beyond which P CL is constant. The reasoning behind this is (apparently) 
that the assumption of a cosine density for initial ROB is a poor one for 
large enough detection ranges. This is reasonable, but just how large is 
"large enough" and how P CL will increase requires more justification than 
currently appears in the documentation. 

To conclude, the subroutine BCLOSE in SUBSUB appears to give 
believable values for P a , but the underlying model is somewhat ad hoc. 
Further analytical justification or validation with simulation results 
seems appropriate here. 

Pr-p ft for Rrea Search . SUB SUB calculates P^pp as follows: 

Pcp fl = 1 - (1 - (u R 2 / R)) exp (-2 R V r t /( fl-JT R 2 ] ) (6) 

where 

R = search area size, 

V r = (Vq 2 + V t 2 ) 1/2 = an "effective" relative speed, 

R = detection range. 

Problems with (6) include: 

1. Target and searcher are assumed to be searching in the same area 
of ocean. This seems a very unreasonable assumption. 

2. V r , the relative speed between the searcher and target, is 
calculated assuming that the target and searcher velocity vectors are 
perpendicular. The more standard assumption is that the angle between 
the velocity vectors is uniformly distributed between 0 and 2n. Then by 
the law of cosines. 



IS 



VTI 



= 1.1 /2n ) J(Vr/ + 'v' T 2 - 2V 0 V T cos©) 1 ' 2 de 



I An ) f [V 0 2 + ’v' T 2 - 2VqV' t cos9) 1/2 d© 



Evaluation of (?) using numerical integration might not be advisable on a 
microcomputer. However, equation (7) is can be approximated by the 
following closed form expression: 

v r ~ .JO Ilia ft l V f|j, V J.I + . OiL I. V | J + v j I 

3. Implicit in (6) is the assumption that the area searched the instant 
the search begins never need be searched again. In effect, the search 
area reduces in size from fl to (R-irR 2 ) at time 0 + . This is consistent with 
a target stationary in relative space but is inconsistent with the 
assumption of a moving target which can migrate into areas previously 
searched. 



Rn alternative expression addressing the above concerns is 

F'rpfilt] = 1.1 - I.tj FriRcij.l/ l.flc ; fl j.l.l expl-2RV r R ; :; T t/(R;:;fl T J.i, (b'J 

inhere fl s is the size of the searcher's patrol area, R T is the size of the 
target's patrol, area, and fl ST is the size of area common to both the 
searcher and the target, fllso, V r is given by (7). 

It is noted that neither (6) nor (8) model convergence zones. Rs a 
minimum modification for convergence zone propagation, the nR 2 term in 
(8) should be replaced with fl cz , which is the area of ocean giving 
convergence zone and direct path detections. For example, if 
detections are possible at ranges of 0-4, 30-33 and 61-63 nrn from the 
searcher, then 



flcz = iT4 2 + tt(33 2 -30 2 ) + jt( 63 2 -61 2 } nrn 2 
= 1423 nm 2 

Probabilit y densit y function for trackin g ran ge. Equation (1.25) of the 
SUBSUB documentation gives the density function for tracking range 

when the searcher has two independent sensors as 

R 

*, : ,(R) = 4WR) + 'WR) - $di(R) J dR', (9) 

-00 

where «{> D1 (R) is the density function for tracking range for sensor 1 and 
4> D2 (R) is the density for the tracking range of sensor 2. (Actually, the 
documentation gives the lower limit of integration as positive infinity, 
but this is assumed to be a typographical error.) Equation (9) is not a 
proper density function since it integrates to a value greater than 1 
(with either sign of the lower limit of integration). The proper form for 
(9) is 

R R 

4> 0 (R) = 4>di(R) + 'WR) - 4>di(R) J 4WR') dR 1 - * D2 (R) I<MR’) dR' . (10) 

-00 -CO 

Probability of Achieving Track g iven no Counterdetection ( TCP ). In the 
SUBSUB documentation, TCD is calculated by conditioning on the range 
required to achieve "track" on the target. In (1.27) of the 
documentation, TCD is expressed as 

^rriax 

I (l-P CD (R)) ''MR) dR 
0 

= Prob{Rr ;D < R track! > RH 



where 4> T (R) is the density function for tracking range, R CD is 
counterdetection range and R TRftCK is tracking range. Given the event 
tree structure of the overall, program, it appears as if the correct 
probability should be conditioned on the searcher achieving a secure 
detection. That is, TCD should be 

Prob{R|-Q < RjrrckI Rcd < Rd}- (12) 

fls long as the target has some secure detection capability (i.e., 

Prob{R C0 < R d } < 1), equation (12) gives a value strictly greater than that 
given by equation (11). 

R suggested simplification of the SUBSUB model would be to assume 
that TCD is some user specified probability, say .8 or .9, depending on 
the searcher’s capability to conduct passive target motion analysis. This 
seems a reasonable assumption and would reduce the number of 
numerical integrations performed. 

Attack Probabilities . Equation (1.28) of the SUBSUB documentation is an 
expression for the probability of a secure attack (FCD). This probability 
is calculated by conditioning on the attacker’s launch range. The 
equation is correct except that the integration should be performed 
from minimum launch range to maximum launch range. This same 
apparent error occurs in Figure 1-6 of the documentation. 

Conver g ence Zone i C Z J Environments . CZ environments are modelled in 
a nonstandard fashion in SUBSUB. It does appear, however, that the 
final effect of CZ propagation on the SUBSUB calculations might be small. 
In CZ environments, P cpfi is modified as follows: 



ia 



Pcpfl(R) = 



PcPfi(R) if R<Rj 



(.13) 



(Pcp fl (R) + p cpfit R cz^2 if R^Rj 

Here R : is the maximum direct path detection range, and R cz is the range 
to the first CZ. The justification given in the documentation is that initial. 
CZ detections mill make subsequent redetection easier, so P CPR should 
be Larger betmeen direct path and CZ ranges. The result of (13) is to 
insert a discontinuity in P CPR at range R r See Figure 5. 
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Figure 5. ^ in a Convergence Zone Environment. 



This modification of F' CPR appears odd considering that in non-CZ 
environments F' CPR is a function of the searcher and target tracks under 
the assumption that detection has not yet occurred. That is, F' C:PR 
reflects only search tactics arid not approach tactics. Also the 
discontinuity at range Rj is difficult to justify intuitively. Furthermore, 
(13) apparently applies in environments with only one CZ. The 



generalization to the rnul tipte-CZ case is not given in the SUBSUB 
documentation. 

It does appear that the effect of this modification of P CPfl might have 
a relatively small impact on SUBSUB calculations, at least in the 
calculation of the probability of a secure detection (BCD). This 
probability is given by 

00 

Prob{R C0 «r} f Ro (r) P CPft (t,r) dr, (14) 

o 

inhere f F ; D (r) is the density function for detection range In a CZ 
environment, f R (r) uuiLL be very near 0 for ranges betujeen Rj and Fi C2 , 

since most initial detections mill occur either in the CZ or at the maximum 
direct path range. But it is for those ranges between Rj and R C2 that P CPR 
is increased. So it ap pears that the CZ modification to P CPfl may, in fact, 
change the evaluation of (14) only slightly. This conclusion might 
change, however, depending on how the rnultiple-CZ modification is 
accomplished. 

Analytical Models and Discrete Time Step Simulations 

SUBSUB is an integrated collection of analytical models. For such 
models to determine whether or not a particular event occurs, an 
expression for the probability of that event is evaluated. Then a 
random number, uniformly distributed between 0 and 1, is drawn. If the 
random number is less than or equal to the calculated probability, then 
the event is said to occur. This is opposed to discrete time step 
simulations (e.g., SIM II, IBGTT and ENUJGS), where the coordinates of the 
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individual platforms are moved during each time step and the status of 
each platform (e.g., course, speed, depth, radiated and self noise levels] 
is updated, fin advantage of analytical models is that, in addition to 
determining whether or not the event in question occurs this time , the 
calculated probability tells the user how likely an occurrence of the 
event will be next time and all subsequent times. This could be 
important if the user needs to know whether a particular outcome is a 
low probability event or something to be expected regularly. 

fln important limitation of analytical models is the possible lack, of 
verified and validated submodels to calculate the required probabilities. 
For example, in SUBSUB one of the flSUJ missions modelled is systematic 
area search for a randomly patrolling target. There exists no simple, 
generally accepted analytical model for this search scenario. UJhat is 
used in SUBSUB is a modified version of Koopman's random search 
expression, even though the search tracks modelled may be anything 
but random. It this a reasonable thing to do? The answer depends on 
the particulars of the situation being modelled. If the relative motion is 
dominated by the target, then random search is probably a good 
assumption. If, on the other hand, the target speed is slow relative to 
the searcher, then a systematic search model would be more 
appropriate. 

Or consider barrier search. The model, used in SUBSUB to compute the 
probability of detecting a transit or assumes (1) a constant speed search, 
(2) the target track is orthogonal to the searcher track, and (3) the 
barrier penetration point is uniformly distributed around a mean position 
at the center of the searcher track. If it is desired to model any other- 
case then SUBSUB may not be appropriate. 
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Or if environmental conditions are changing with position or time (such 
as in the marginal, ice zone), then SUBSUB would probably not be the be 
choice. 

Discrete time step simulations, on the other hand, are more robust 
and can generally consider more types of scenarios. If, for example, it 
is desired to know if a transitor successfully penetrates a barrier when 
the searcher conducts a sprint and drift search, the physical situation is 
established (initial positions, courses, speed, ranges, and depths) and 
one replication of the simulation is run. Either detection occurs or it 
does not. fin advantage of this method is that the modelling can often 
be simple, geometric, and straightforward (compared to analytical 
models which frequently become rather esoteric). The disadvantage of 
this method is that it does not give a probability of event occurrence 
u n less rn anyreplicationsa re p e rf o rm e d . Butforseminar lu a rg a rn e s , 
probabilities are often of secondary importance. UJhat is of primary 
concern is typically whether or not a particular event happens. 

To conclude this section, it is suggested that there are probably some 
missions and scenarios modelled in SUBSUB which could be handled in a 
more straightforward manner with a discrete time step simulation. 

Conclusions 

SUBSUB is a large program. It is a collection of analytical models 
which address the phases of one-on-one submarine engagements from 
search through detection, classification, closure, attack and 
counterattack, find it appears to run reliably on an IBM-F'C 
microcomputer. 
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The basic structure of the program is a conditional event tree, uuhich 
is hard to fault. However, some of the component models do have 
limitations or errors which should be addressed in the documentation 
and subsequent revisions of the program. This report mentions some of 
these problems, but there may be others which escaped notice. 

In spite of the program's shortcomings, it is judged to be better than 
the microcomputer programs previously used at NLLIC to evaluate 
submarine engagements. It is recommended that the current version of 
SUBSUB be used by NUJC, but that the known errors be corrected and the 
technical documentation formalized as soon as feasible. 

One separate but related issue briefly raised was whether analytical 
models or discrete time step simulations are more appropriate for 
seminar war games. There is probably a place for both. If analytical 
models are used, however, it is very important to know the modelling 
assumptions coded into the expression for probability of event 
occurrence. These assumptions might be more restrictive than one 
would like. Compared to analytical models, simulations tend to be more 
robust and transparent to the user. However, they can take longer to 
run and do not give the probability of event occurrence. 
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